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Abstract 



We establish sufficient conditions for the asymptotic normality of 
kernel density estimators, applied to causal linear random fields. Our 
f-H \ conditions on the coefficients of linear random fields are weaker than 

^0 ■ known results, although our assumption on the bandwidth is not min- 

fH | imal. The proof is based on the m-approximation method. As a key 

step, we prove a central limit theorem for triangular arrays of station- 
ary m-dependent random fields with unbounded m. We also apply a 
moment inequality recently established for stationary random fields. 
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(Ni ■ 1 Introduction 

O , 

Let {Xi} iGZ d,d G N be a stationary zero-mean random field, such that the 
marginal probability density function p(-) exists. We are interested in the 
Parzen-Rosenblatt kernel density estimator of p{x) in the form of 

^ = i E K(^i), x ,«. (1) 

S3 



n d b n ' V b n 
ie[l,n] d 



Throughout this paper, we assume that the kernel K : K — )■ R is a bounded 
Lipschitz-continuous density function, and the bandwidth b n satisfies 

b n — > and n d b n — > oo as n — > oo . (2) 

We also write, for a, b 6 Z, [a, b} = {a, a + 1, . . . , b}. 

This problem was first considered by Rosenblatt [20J and Parzen |15j . 
in the case that X^s are independent and identically distributed (i.i.d.) 
random variables: in particular, one can show the consistency 

lim f n (x) = p(x), 
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and the asymptotic normality 

{n d b n ) l l 2 (f n {x)-^f n {x))^M{Q,al) as n -> oo , (3) 

where a 2 = J K 2 (s)ds. See for example Silverman [21] for more refer- 
ences on density estimation problems with i.i.d. data. 

The case that X^s are dependent, however, has presented more chal- 
lenges, and we focus on establishing the asymptotic normality @ in this 
paper. The dependent one-dimensional case has been considered by Robin- 
son [19], Castellana and Leadbetter [2], Bosq et al. [I], Wu and Miel- 
niczuk [27] and Dedecker and Merlevede |8], among others. In particular, 
Wu and Mielniczuk [27J investigated thoroughly the case when {JQ}j g z is a 
linear process. That is, 

oo 

Xi = a k£i-k , i € Z , 

fc=— oo 

where ^fc°fe < 00 an( ^ the innovations {ej}j g ^ are i.i.d. random variables. 
Linear processes are important in the study of stationary processes, as any 
stationary process can be represented as linear combinations of linear pro- 
cesses (the so-called superlinear processes) with martingale-difference inno- 
vations (Volny et al. [24]). 

The asymptotic normality of kernel density estimators for random fields 
has been considered by Tran [22], Hallin et al. [13], Cheng et al. [4] and El 
Machkouri [10||11|. among others. The extension of results in one dimension 
to high dimensions, however, is not trivial. As summarized in Hallin et 
al. |13j . 'the points of 7L d do not have a natural ordering. As a result, most 
techniques available for one-dimensional processes do not extend to random 
fields.' See more references in [13] on related discussions. 

In particular, a notorious difficulty for kernel density estimation of ran- 
dom fields, is that one often needs more assumptions on the bandwidth b n 
than the minimal one ([2]) . This condition is minimal in the sense that it is 
the natural condition for the asymptotic normality ([3]) to hold when X^s 
are i.i.d. To the best of our knowledge, only the recent results by El Machk- 
ouri [TOj E] assume no other but minimal condition ([2]) on b n for dependent 
random fields. 

In this paper, we focus on the kernel density estimation for causal linear 
random fields {Xi} ieIi d (d £ N) in form of 

Xi= Yl a k ei_ k ,ieZ d , (4) 

where Xli^o a i < 00 an d {ei}iez d are i.i.d. zero-mean random variables with 
finite second moments. Throughout this paper, we let L i >z k' denote l i T > k T 
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for all r = 1, . . . , d' for i, k € Z d , and write = (0, . . . , 0), 1 = (1, . . . , 1) G 
Z d . 

We provide new conditions on the coefficient {ai} ie %d such that the 
asymptotic normality (|3|) holds (see Theorem[T]below), and compare with re- 
sults obtained by Hallin et al. [13] and El Machkouri [11]. In both cases, our 
conditions are weaker on the coefficients {ai} ie i<i. On the other hand, our 
condition on the bandwidth improves the one in [13], but it is still stronger 
than the minimal one ([2]) assumed in [11] . We do not compare our result 
with Cheng et al. [I] , as there is a mistake in their proof (see Remark [UJ 
below) . 

Our proof is based on the m-approximation approach. As we will see, 
to address this problem one has to establish an m-approximation with un- 
bounded m (m n — > oo as n — > oo). As a key step of our approach, we establish 
a central limit theorem for triangular arrays of stationary m-dependent ran- 
dom fields with unbounded m (Theorem [2|) . This result improves a central 
limit theorem established by Heinrich [14J . Our m-approximation method is 
also involved with certain moment inequalities for stationary random fields 
(Lemma [5]). These moment inequalities are variations of the one established 
in Wang and Woodroofe [25J, based on the maximal inequalities for sta- 
tionary sequences (d = 1) by Peligrad and Utev [IB] (see also [I7JI23])- In 
general, the m-approximation method has been successful in proving cen- 
tral limit theorems for random fields (see e.g. Cheng et al. [3J, Wang and 
Woodroofe [25] and El Machkouri et al. [12J). In particular, El Machk- 
ouri [10\ [TT] also established m-approximations with unbounded to, com- 
bined with Lindeberg's method (see e.g. Rio [18] and Dedecker [BJ), to prove 
asymptotic normality. 

At last, we point out that when the asymptotic normality ([3]) holds, the 
random variables are often said to have weak dependence, in the sense that 
they behave asymptotically as i.i.d. random variables. On the other hand, 
when the dependence is strong enough, the normalization for obtaining lim- 
iting distributions is of different order from n d b n in (J3J), and the asymp- 
totic limit may be no longer Gaussian (see e.g. Csorgo and Mielniczuk [5] 
for one-dimensional case). These two regimes are sometimes referred to as 
short-range dependence and long-range dependence, respectively. For linear 
processes, Wu and Mielniczuk [27] addressed both short-range and long- 
range dependence cases. For the linear random fields, however, to the best 
of our knowledge, the long-range dependence case remains open. It seems 
that the m-approximation method is limited to the short-range dependence 
case. Therefore, the long-range dependence case is beyond the scope of this 
paper. 

The paper is organized as follows. Our assumptions and main results 
are presented in Section Examples and comparison with other results 
are provided in Section [3J Section 0] is devoted to the central limit theorem 
for triangular arrays of m-dependent random fields. Section [5] establishes 
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asymptotic normality by m-approximation. Auxiliary proofs are given in 
Section [6j 



2 Assumptions and the main result 



We first introduce our conditions. For each m G N, i G Z d , 



write 



Xi 



/ J a k e i-k an d Xi )Tn — Xi — Xi jTn . 
fce[0,m-l] d 



(5) 



Let 

Vi Pm an< i Pm denote the probability density function of Xq, Xo m 
and Xo,mj respectively. Let pi and Pi im denote the joint density functions 
of (Xo,Xi) and (Xo >m , X^ m ), respectively. Our first condition is on the 
regularity of the density functions. Define the supremum p = sup x p(x), 
Pi = snp Xjy pi(x,y) and similarly p m and p i m . 

Condition A. (i) The density functions p and {p m } m gN exist. They are 
co-Lipschitz continuous with certain constant cq < oo, independent of m 
(i.e., max(|p(x) - p(y)\,\p m (x) - p m (y)\) < co|s-y|). Furthermore, 



(ii) The density functions pi andpj jrra exist for alH 7^ 0, m G N. Furthermore, 



Condition [A] can be satisfied, for example, by simply assuming that the 
probability density function p e of eo exists and is Lipschitz. This was as- 
sumed also in Wu and Mielniczuk |27j . 

Lemma 1. If p e exists and is Lipschitz, then Condition LTl holds. 
The proof is deferred to Section [6l 

Our second condition is on the decay of coefficients and bandwidth b n . 
Define 



p < 00 and sup p m < 00 . 



(6) 



m 



sup Pi < 00 and sup sup p i m < 00 . 



(7) 




ie[0,oo] d 



i|oo>m 



with \i 



maXr=i d \i T \. Write 
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Condition B. There exist a sequence of integers {m n } n ^ such that m n — > 
oo as n — > oo, and the following limits hold: 

lim bl/ 2 A n = 0, (8) 

n— »oo 

U m %n = 0, (9) 



n— >oo 



lim m a n b n = 0, (10) 
log 

7i->oo n d b r 



lim n = 0. (11) 



Theorem 1. // Conditions\^and\^hold and E(|eo| a ) < oo for some a > 2, 
then the asymptotic normality (|3j) holds. 

We will prove Theorem [1] in Section [5j We conclude this section with a 
few remarks. 

Remark 1. We briefly comment on each condition in Condition [Bl 

(i) Condition ([8]) is slightly weaker than 

fce[l,oo] d llr=l 

It was shown in [25] . Corollary 1 that, the above condition implies the 
asymptotic normality of Yli£{i n] d I/(^) ~~ ^Lf(Xo)]/n d / 2 for Lipschitz 
continuous function / such that E/ 2 (Xo) < oo. 

(ii) Condition Q implies that 

lim E|X °' mJ =0. (12) 

n— s-oo b n 

Indeed, Wu [26J, Lemma 4 showed that for i.i.d. zero- mean random 
variables {ej} ig z with E(|e | 2v2p ) < oo,p > 0, 

E (|E a ^f P ) <c(J2 a ") P - ( 13 ) 

i i 

Intuitively, Xo iUln can be viewed as the remainder of Xq after the m n - 
truncation. Condition ()12j) tells that m n needs to tend to infinity fast 
enough, so that the central limit theorem holds. 

(iii) Conditions (|10p and (|lip are useful when we apply a central limit the- 
orem for m-dependent random variables with unbounded m in Propo- 
sition [1] below. 

Throughout this paper, let C denote constants that do not depend on 
i, k, m, n, x, y. The value of C may change from line to line. 
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3 Examples and discussions 

Theorem [H and particularly Condition [Bj is not convenient to apply for 
concrete models. Instead, we provide a corollary for practical reason. Write 

A[ n ] = max{Ai,l,...,l>^l,n,l,...,l, ■ • • , M,...,l,n} ■ 

Corollary 1. Suppose A\ n i < c\n~^ and 8 > 0, and b n = C2n~ 1 . Then a 
sufficient condition such that Condition [B] holds is 

dB 

7<^- —: and 8>d. (14) 
d + B v ' 

Consequently, z/E(|eo| a ) < oo for some a > 2, and Condition^ and (fT4"|) 
hold, then the asymptotic normality ([3]) follows. 

Proof. Assume that m n takes the form of [^J • Observe that B mn is of the 
same order of ^4[ m „] as n — > oo. Then, the limit conditions ([9|), (jlOp and (jlip 
are implied by 

lim rT^ + n dS -~* + n 5 " 1+7 / d = , 

which is equivalent to "f/B < 5 < min^/d, 1 — j/d}. Since 8 > d implies 
that Aqo < oo, the desired result follows. □ 

Remark 2. Under the assumptions of Corollary [TJ Condition (|14p is very 
close to necessary for Condition [B] to holds. Indeed, if Ar n i = l(n)n~@ 
with linin^oo l(n) = C2 > 0, then the same argument above yields that 
Condition [B] is equivalent to (fl~4 



Below, we provide examples of coefficients so that Condition [B] holds. 
We assume that b n = n~ 7 for some 7 G (0,d). 



Example 1. We compare our conditions and the ones by Hallin et al. |13j . 
They considered the case that |aj| < C\i\^,i y 0. Then, they require 

q > max(d + 3, 2d + 1/2) and lim n ^(2 g -i+6d)/(2 g -i-4d) = ^ _ ^ 

n—>oo 

Our condition (|14p imposes weaker assumption in this case (with b n = ra~ 7 ). 
First, observe that 

00 

< ^ < c JV-V 2 " < Cn d - 2 ". 

We can apply Corollary Q] with B = q — d/2. Then, (fT4"|) becomes 

g > and 7 < d H 7 . 16 

2 g + a/2 

Thus, to establish the asymptotic normality ([3]), our condition (|16p is less 
restrictive than (fT5j) on both g and 7. 
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Example 2. We compare our conditions and the ones by El Machkouri 
Note that his results apply to general stationary random fields and the linear 
random fields are a specific case. In particular, he showed that for causal 
linear random fields, if 

J2\i\Uai\<°° (17) 

with q = 5d/2, then the asymptotic normality follows. 

In this case, our condition on the coefficients is weaker, requiring only 
q > d. Indeed, suppose (fTTj) holds with some q > 0. Then, to apply 
Corollary [H it suffices to observe 

oo oo 

il=ni2,...,id6N ii=n i2,...,idGN 

and take /3 = q. 

At the same time, our result requires 7 < dq/(q + d) for the bandwidth, 
in addition to the minimal one ([2]) assumed in Recall also that we 

assume E(|eo| a ) < 00 for some a > 2, while El Machkouri's result needs 
only finite-second-moment assumption on eo- 

Remark 3. Finally, we compare our result to Wu and Mielniczuk [27]. In 
the one-dimensional case, to have asymptotic normality they assume only 
finite variance of eo and weaker assumption on the coefficient: 

00 

y] laji < 00 . (is) 

i=0 

This is weaker than our condition in one dimension (with q > d = 1 in (|17p). 

Wu and Mielniczuk followed a martingale approximation approach. It 
remains an open question that in high dimension, whether the condition 
q > d in (|17p can be improved to match (|18p in dimension one. 



4 A central limit theorem for m-dependent ran- 
dom fields 

In this section, we prove a central limit theorem for stationary triangular 
arrays of m-dependent random fields. Throughout this section, let {Y n ^ : 
i G N^jngN denote stationary zero-mean triangular arrays. That is, for 
each n, {Yn,i\ien d ls stationary and Y n> i has zero mean. Furthermore, we 
assume that {Y n ^} ieN d is m„-dependent in the sense that Y n ^ and Y n j are 
independent if \i — j\oo > m. We provide conditions such that 



^dlT = ^df2 AA(0) a )asn^oo. (19) 
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A key condition is the following: 



E 



Y, 



< C(ji ■ ■ -id) 1/2 for all n G N, j £ N° 



(20) 



Remark 4. Inequality (|20p has been established, under various conditions 
on the dependence of stationary random fields, by Dedecker [7|, Wang and 
Woodroofe [25] . and El Machkouri et al. [12], among others. 

Theorem 2. Suppose that there exists a constant C such that (|20p holds. If 

there exists a sequence {l n }neN C N, m n /l n — )• and Z n /n — )• as n — > oo, 
such that 



1 



lim -tE 

n-voo /« 



lim -rE 

n— >oo Z" 
n 



E 



a 



E 

fce[i,M d 



■{| E F ->* 



> n 



d/2. 



(21) 
0, (22) 



for all e > 0, i/ien (|19p holds. 

Proof. Consider partial sums over big blocks of size l d , denoted by 

Vn,k = ^n,i+fc(Z n +m n ) £ 

ie[i,M d 

In this way, for each n £ N, {nn,fc}fceN d are i-i-d. , as we separate neighboring 
blocks by distance m n , and {Y Hj i} ieZ d are m n -dependent. Set 

S n(v) = E In.li.neN. 

fce[0,|n/(i n +m n )J-l]] d 

Then, ([20]) implies that 

S n (Y) S n ( V ) 



d/2 



d/2 



as n — > oo . 



To see this, for the sake of simplicity, we consider the case n/(l n + m n ) = 
\nj (l n + m n )\ . Indeed, by the triangular inequality, the left-hand side above 
can be bounded by sums in form of ||X^ieB Y n ^ 2 /n d l 2 , where B can be a 
rectangle of size n d ~ r m n with r € {1, . . . , d— 1}. Focusing on the dominant 
term with r = 1, we then bound the left-hand side above by C(n/(l n + 
m n )) 1 ' /2 (n d_1 m n ) 1 / 2 jn d l 2 = Cml/ 2 /(l n + m n ) 1 / 2 — > oo as n — > oo. 

As a consequence, it suffices to show S n {ri)/n d l 2 =^ AA(0, a 2 ). This, under 
conditions (|2ip and (|22p . follows from the standard central limit theorem 
for triangular arrays of independent random variables (see e.g. [S], Chapter 
2, Theorem 4.5). □ 
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Remark 5. Central limit theorems for m„-dependent random fields has 
been considered by Heinrich p3]. His result has been recently applied, with 
m n = m fixed, by El Machkouri et al. [12] to establish a central limit theorem 
for stationary random fields. 

Our application requires us to take m n — > oo (see Remark [6] below). In 
this case our condition in Theorem[2]is weaker than Heinrich's. In particular, 
he assumed 

i™c 5- ^ E { Y ^hY,M>^ m -J* } ) = , for all , > . (23) 

ie[l,n] d 

This is stronger than (|22p . 



5 Asymptotic normality by m-approximation 

In this section, we prove Theorem Q] by an m-approximation argument. Fix 
i£R and write 

Z ni = J- K (^^-) and Cm = -^K( X ~? i ' m " ),i£Z d . 

In this way, {Cn,i}i^z d are "in-dependent. We will use {( n ,i '■ i G ^ d }nen 
to approximate {Z n ^ : i E Z d } ne ^. We also write Z n ^ = Z n> i — EZ Hi i and 
Cn,i = Cn,i - ECn.i- Setting 

S'n(C) = J] and 5* n (Z-C)= ^ (^n,<-Cn,<)> 

we decompose 

(n^) 1/5 U(*) _ E / B (x)) = ^r + ■ (24) 

To prove Theorem [H it suffices to establish the following two results. 
Proposition 1. Under Condition^ and flS}, (flO)) . (fTT|) of Condition Wl 

^=>^(°><#- (25) 
Proposition 2. Under Condition^ and p]). Q of Condition Wl 

S n (Z-C) 



n 



d/2 



0. (26) 



To prove the above two propositions, a key step is to establish the fol- 
lowing moment inequalities. 
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Lemma 2. There exists a constant C > 0, such that for all n £ N, 



\\S n (Z - C)|| 2 < Cn d / 2 (\\Z n , - C n , || 2 + &n /2 A n ) . (27) 
In addition, i/E(|eo| a ) < oo for some a>2, then 

< C(h ■ • • Jd) 1/2 (||Cn,o|L + bl n /2A n) , f or all J € N d . 



^ ] Cn,i 



(28) 



These inequalities are consequences of the moment inequality recently 
established in Wang and Woodroofe [25] . The proof is deferred to Section [6) 

Proof of Proposition^ Observe that S n (()/n d ^ 2 is a partial sum of m n - 
dependent random fields and we apply Theorem [2j Observe that since 
1 1 Cn,o 1 1 2 — ^ o~ x &s n — y oo, ([2"5j) with a = 2 and assumption ([5]) entail (|2"D|) . 
Thus, to prove ([25]) . it suffices to show, for l n = m n logn, 



1 



lim -tE 



^ ] Cn,i 

ie[i,M d 



o~„ 



(29) 



and, writing £ n = Eie[i,j n ]<< Cn,i> 
1 



, for all e > . 



(30) 



By standard calculation, under ([7]) of Condition |XJ for all n E N and j ^ 0, 

l E (C„,oC„,JI < Cp i mn b n < Cb n . 

Therefore, 



I ■> i 



E 



<2 |E(Cn,oCn,J|l{^o}<CmX 



ie[— m„,m„] d 

Thus, assumption ([TTJj) entails ([2"9"j) , To prove ([50]) . observe that 



E(^i {lfnl>nd/M )<ne„ii 2 p(ieni>n^6 



d/2 x(a-2)/a 



< II& 



\a\ n d e 2 



This time, ([25} and © yield ||£ n || 2 < C/^ /2 . For a > 2, observe that, since 
K is bounded, 



llQoL = (E|C„,oH 1/Q < (77^l|Cn,o||^ /a < Cb-^") 



1/a 
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So, \\l < Cl d n b n {a 2)/a . To sum up, we have obtained that 

1 2 / l d \("-2)/a 

Now, (TTTD entails (GUI). □ 



Proof of Proposition^ To obtain the desired result, it suffices to com- 
bine (p7|) . assumptions (|8|) and © and Lemma [3] below. □ 

Lemma 3. Under the assumption of Condition [31 there exists a constant 
C , such that for all n G N, 

||Co-^,o|| ,<c\(^Y /2 + b^]. (31) 
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The proof is deferred to Section EJ 



Remark 6. Cheng et al. [1] also considered the asymptotic normality of 
kernel density estimators for linear random fields. Their approach combines 
an m-approximation with a martingale approximation by defining an appro- 
priate filtration in Z 2 . However, there is a mistake in Lemma 2 therein. In 
our notation, they claimed that, instead of (|3ip . there exists a constant C, 
such that (in the case d = 2) 

\\Cn,o ~ Zn,a\\ 2 < Cb n with m n = m. (32) 
To see that (|32|) is not true, observe that 

||Cn,0 " Z n!0 f 2 = E(l +EZl Q - 2E(Cn,0^n, ). 

By standard calculations, lim n _ i , 0O EZ 2 = p(x) J K(s) 2 ds, and if m n = 
m, then lim^oo E^q = Pm(x) j K(s) 2 ds and lim n ^oo E(C n ,o^n,o) = 0. 
Therefore, the left-hand side of ([32]) has a strictly positive limit as n — > oo 
(unless p(x) = p m (x) = 0), thus a contradiction. Their approach might still 
work by adapting an m-approximation with unbounded m, although it is 
not clear to us what conditions it would lead to. 

6 Proofs 

Proof of Lemma [7J (i) The existence and Lipschitz continuity of p and p m 
have been proved by Wu and Mielniczuk [27], Lemma 1. To prove 
observe that 



\pm(y)-p(y)\ < J \pm(y) - p m (y - x)\p m (x)dx 

< C j \x\p m (x)dx = CE|X , m | . (33) 
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This entails that p m (x) — > p{x) uniformly for x £ R as m — > oo. There- 
fore, © holds. 

(ii) Fix i € Z d \ {0} and let Fi denote the joint distribution function of 
(Xo,Xi). For the sake of simplicity, we prove the case of ao = 1. Write 
R = Xo — eo and Ri = X{ — ej — a^eo- Now, i? and Ri are dependent random 
variables. First, we show that 



d 2 

Pi{x,y) = Q^-Fi(x,y) = E[p e (x - R)p e {y - Ri - aix)\ . (34) 



Indeed, 



Fi(x,y) = F(X < x ,Xi<y) 

= P(e + R < x, a + aie + Ri < y) 

= E$i(x-R,y-Ri), (35) 

with, letting F e denote the cumulative distribution function of eo, 

/X 
F e (y - a iX ')F e (dx') . 
-oo 

Differentiating ([35]) yields (|5S]> (see e.g. [9], Appendix A. 9 on the validation 
of exchange of differentiation and expectation). 

Next, we prove (|7j) by establishing the following two steps: 

lim sup \pi(x, y) - p{x)p(y - a,ix)\ = , (36) 

i|oo— >oo x ,y 

and 

lim sup \pi(x, y) - Pi, m (x, y)\ = . (37) 

m ^°° x,y,i 

Then, (|36|) implies the first part of ([7]), and the two limits imply the second 
part. 

To prove (|3"6"|) . set 

Di = E(JBj | a(e k : k ^ 0)) and D i = R i -F> i ,i G 

By definition, L>j and i? are independent. Introducing an intermediate term 
E[p e (x — R)p e (y — Di — dix)] = p(x)Kp e (y — Di — dix), we then bound 
\pi(x, y) — p(x)p(y — a>ix)\ < + ^2 with, under the assumption that p e is 
bounded and Lipschitz, 

^1 = \pi(x,y) - E\p t (x - R)p e (y - Di - aix)]\ 
< E[p e (x - R)\Ri - Di\] < CE\Di\, 
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and 



^2 = \p{x)p{y - aix) - E\p e (x - R)p e (y - Di - <nx)]\ 

< p(x)E\p t (y - <nx - Ri + ai€ ) - p t {y - Di - <nx)\ 

< C(E\Di\ + \oi\). 

By (USD, \pi(x,y) -p(x)p(y - cnx)\ ->■ as |z|oo -)■ oo. 

To prove (J37J) , define R m = X , m - e and i?;, m = X^ m - - 
3 <m}- Then, similarly as (|34p. one has 

Pi,m(x,y) = E[p e (x - R m )Pe{y - OiXlftq^ny - R i>r n)} • 

Introducing an intermediate term E[p £ (x — R)p t {y — aix\su\ <m \ — Ri )Tn )], 
we obtain that 

\Pi,m{x,y) -pi(x,y)\ 

< E[p e {x - R)(\ ai x\l {liloo > m} + \Ri - Ri tm \)] + CE\R - R m \ 

< C(|a;|p(x)|ai|l{| i | (x) > m } + \R- R m \ + \Ri - Ri,m\) ■ 

Clearly, since Xq has finite second moment and p is bounded and Lips- 
chitz, sup^, |x|p(x) < oo. The summability assumption on <Zj implies that 
lim m ^ 00 sup| i | oo > m \di\ = 0, and supj(|i?- R m \ + \Ri -Ri, m \) ->■ as m -)■ oo 
(recall (|13f) ) . Therefore, we have thus proved (|37p . □ 

Proof of Lemma\^ We only prove (|27p . The proof of (|28[) is similar. By [25], 
Corollary 2, there exists a constant C, such that 



Sn(Z-Q\\ 2 



n 



fce[l,n] d 



E(Z n , k -Cn,k l^l)| 



(38) 



where = cr(efc : A; € A; ^ 1). By the definition of ( n i; ([38]) equals (up 
to the multiplicative constant C), 




where the last inequality follows from Lemma 2] below. 



□ 
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Lemma 4. Suppose that in addition to Condition\^ E(|eo| a ) < oo for some 
a>2. For all k G N d ,k ^ 1, 



\\E(Z n>k | Fi)\\ a < Cb\[ 2 A k _ x , (39) 

||E(Cn, fc l^"l)L < Cb\l % A k _ X . (40) 

Proof of Lemma^ First, we control llE^^ | -^i)]) • For each k E 
introduce the notation 



T(k) := {i G Z d : i * k} 



(41) 



and write 



ier(k) 



/2 + /2 ) a k-i e i =: D k + T k ■ 

ier(i) ier(fc)\r(i) 



For the sake of simplicity, write D = D k ,T = T k , and, given a random 
variable Y, let Ey(-) = E(- | Y) denote the conditional expectation given 
the cr-algebra generated by Y. Since k >z l,k ^ 1, T k is a non-degenerate 
random variable. Then, 



nZn,k I Ji) 



1 



E 



x-D-T 
K 



EK 



x-D-T 



Let D be a copy of D, independent of D and T. Then, the above identity 
becomes, letting pt denote the density of T, 



1 



e d e dB 



K 



x-D-T 



K 



x-D-T 



b n / " \ b n 
bl/ 2 E D [ K(t) \pr(x - b n t — D) — PT (x - b n t - D) 



dt. 



Since P t is Lipschitz, the absolute value of the above term is bounded by 

1 /2 ' — ' 

C J \K(s)\dsb n Ed\D — D\, almost surely. (Here pt depends on k,n, but 
one can show that the Lipschitz constant can be chosen independently from 
k,n. See e.g. |26], Lemma 1.) To sum up, we have 



E D \D - D\ 



^Cbl/'WDWKCb^A^, 



\HZn,k\ <Cbl/ 2 



where the last inequality follows from ()13p . We have thus proved (|39p . To 
prove (00]), a similar argument yields ||E(£ njfc | ^l)^ — Cb\[ 2 A k ^ mri with 

Ak,m n = (X}ie[0,7ra„-l]d,ifcfc-l a f ) - A-k-1- □ 
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Proof of Lemma\^ For random variables Z n ,o> Zn,o, Cn,o, C n o> we replace 
the index 'n, 0' by 'n' for the sake of simplicity. First observe that 

(EZ n ) 2 + (EC„) 2 < C(fb n +f mn b n ) < Cb n , 

where the last step we applied ([7]). Then, 

~ 2 ' ' ' ' ' • +Cb„ 



(42) 



E(C-K)\ < J K 2 (y)[p mn (x-b n y)-p(x-b n y)]dy 

< sup \p mn (y) -p(y)\ / K 2 (s)ds + Cb n . 

y J 

< C(B mn + b n ), 

where the last inequality follows from (|33p . Next, write 



|C n - Z n \\l = Ez\ - E(l + 2(E(l - E(Z n ( n )) ■ 



(43) 



For the last term on the right-hand side of (|43|). observe that E(Z n ( n ) = 
E{Z n ( n ) - EZ n E( n = E(Z„Cn) + 0{p mn b n ). We claim that E(Z„Cn) is very 
close to E£ 2 , under our restriction on the choice of m n . Indeed, 



E(Z n ( n ) - EC 2 ] = |E(Z„Cn) - J K 2 (y) Pmn ( 



x - b n y)dy 



(44) 



and, 



nZnCn) 



(y)Pm„(z)dydz 
K{y)EK[y - ^^-)p mn (x - b n y)dy . 



Therefore, (|i"4"|) can be bounded by, since K is Lipschitz, 



/ 



K(y)\E 



h'((j ~ ~ K(y) p mn (x - b n y)dy 



< ElX °' mJ I \K(y)\p mn (x-b n y)dy. 



and E|Xo im „| < CB mn by (fT3j) . To sum up, we have thus shown that (recall 
that b n I 0, whence B mn is dominated by B mn /b n ), under ([6]), 



\l n -Z n \^<c(^+b, 



□ 
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